Augmentation of textual content with a digital scene

ABSTRACT

Computer-readable storage media, computing devices and methods are discussed herein. In embodiments, a computing device may include one or more display devices, a digital content module coupled with the one or more display devices, and an augmentation module coupled with the digital content module and the one or more display devices. The digital content module may be configured to cause a portion of textual content to be rendered on the one or more display devices. The textual content may be associated with a digital scene that may be utilized to augment the textual content. The augmentation module may be configured to dynamically adapt the digital scene, based at least in part on a real-time video feed, to be rendered on the one or more display devices to augment the textual content. Other embodiments may be described and/or claimed.

TECHNICAL FIELD

Embodiments of the present disclosure are related to the field ofaugmented reality, and in particular, to augmentation of textual contentwith a digital scene.

BACKGROUND

The background description provided herein is for the purpose ofgenerally presenting the context of the disclosure. Unless otherwiseindicated herein, the materials described in this section are not priorart to the claims in this application and are not admitted to be priorart by inclusion in this section.

Textual content such as physical or electronic books contain manyelements that may elude the senses. When reading an electronic book thereader has to rely on the reader's own imagination to visualize what isdescribed in the book. As such, the reader may miss out on details ofthe book.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a computing environment, in accordance with variousembodiments of the present disclosure.

FIG. 2 is an illustrative depiction of an example content augmentationenvironment generating an augmentation video feed.

FIG. 3 is an illustrative depiction of various camera orientations andthe effect of the various orientations on the portion of the digitalscene, in accordance with various embodiments of the present disclosure.

FIG. 4 is an illustrative depiction of navigation from a first portionof textual content to a second portion of textual content, in accordancewith various embodiments of the present disclosure.

FIG. 5 illustrates an example process flow for dynamic adaptation of adigital scene to augment textual content, in accordance with variousembodiments of the present disclosure.

FIG. 6 illustrates an example process flow 600 for selecting a portionof a digital scene based on camera orientation, in accordance withvarious embodiments of the present disclosure.

FIG. 7 illustrates an example process flow for navigation from oneportion of textual content to another portion of textual content, inaccordance with various embodiments of the present disclosure.

FIG. 8 is a schematic illustration of an example computing device, inaccordance with various embodiments of the present disclosure.

FIG. 9 illustrates an example non-transitory computer-readable storagemedium having instructions configured to practice all or selected onesof the operations associated with the processes described above.

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

Methods, computer-readable media, and computing devices associated withaugmentation of textual content with a digital scene are describedherein. In embodiments, a computing device may include one or moredisplay devices, a digital content module coupled with the one or moredisplay devices, and an augmentation module coupled with the digitalcontent module and the one or more display devices. The digital contentmodule may be configured to cause a portion of textual content to berendered on the one or more display devices. The textual content may beassociated with a digital scene that may be utilized to augment thetextual content. The augmentation module may be configured todynamically adapt the digital scene, based at least in part on areal-time video feed, to be rendered on the one or more display devicesto augment the textual content. For example, the portion of textualcontent may be a page from an electronic book and the digital scene maybe designed to depict a scene described by the page from the electronicbook. As such, a user of the computing device may be able to not onlyread and imagine what is described by the page of the electronic book,but may also be able to see what is described by the page come to lifeon the display via the digital scene.

In the following detailed description, reference is made to theaccompanying drawings which form a part hereof wherein like numeralsdesignate like parts throughout, and in which is shown, by way ofillustration, embodiments that may be practiced. It is to be understoodthat other embodiments may be utilized and structural or logical changesmay be made without departing from the scope of the present disclosure.Therefore, the following detailed description is not to be taken in alimiting sense, and the scope of embodiments is defined by the appendedclaims and their equivalents.

Various operations may be described as multiple discrete actions oroperations in turn, in a manner that is most helpful in understandingthe claimed subject matter. However, the order of description should notbe construed as to imply that these operations are necessarily orderdependent. In particular, these operations may not be performed in theorder of presentation. Operations described may be performed in adifferent order than the described embodiment. Various additionaloperations may be performed and/or described operations may be omittedin additional embodiments.

For the purposes of the present disclosure, the phrase “A and/or B”means (A), (B), or (A and B). For the purposes of the presentdisclosure, the phrase “A, B, and/or C” means (A), (B), (C), (A and B),(A and C), (B and C), or (A, B and C). The description may use thephrases “in an embodiment,” or “in embodiments,” which may each refer toone or more of the same or different embodiments. Furthermore, the terms“comprising,” “including,” “having,” and the like, as used with respectto embodiments of the present disclosure, are synonymous.

FIG. 1 illustrates a computing environment 100 in accordance withvarious embodiments of the present disclosure. Computing environment 100may include computing device 102 which may include content augmentationenvironment 122. Content augmentation environment 122 may include adigital content module 106, an augmentation module 108, and a planecalculation module 110. Each of these modules is discussed furtherbelow. Computing environment 100 may further include a camera 104coupled with computing device 102. While depicted herein as beingintegrated into computing device 102, camera 104 may, in someembodiments, be peripherally attached to computing device 102. Inembodiments where camera 104 is peripherally attached, camera 104 may becommunicatively coupled with computing device 104 via any wired orwireless connection suitable for transmitting data captured by camera104.

Camera 104 may be disposed in computing environment 102 and configuredto capture a real-time video feed of a physical scene (e.g., physicalscene 116). In embodiments, camera 104 may be configured to capture bothdepth and color information in individual frames of the video feed. Insuch embodiments, camera 104 may incorporate a depth sensor, such as, aninfrared emitter utilized in combination with an infrared imagecapturing sensor, as well as a two dimensional (2-D) image capturingsensor, such as a red, green and blue (RGB) camera sensor. Computingdevice 104 may be configured to receive these captured images fromcamera 112 and provide the captured images to augmentation module 108.

Digital content module 106 may, in some embodiments, be configured tocause a portion of textual content (e.g., textual content 112) to berendered on a display device of computing device 102. In someembodiments, digital content module 106 may be configured to merelyreceive the portion of textual content and format the portion of textualcontent for rendering on the computing device 102. In such embodiments,the portion of textual content may be received locally from anothercomponent of computing device, such as, for example, an electronic-book(e-book) application. In other embodiments, digital content module 106may be configured to retrieve the portion of textual content from astorage device, either local or remote, in response to selection of theportion of textual content by a user of computing device 102 or at theinstruction of another component of computing device 102, such as thee-book application mentioned above. In embodiments, the portion oftextual content may be a portion of a digital book, digital magazine, orany other suitable textual content source.

In embodiments, the portion of textual content may be associated with adigital scene (e.g., the digital scene depicted in augmentation videoscene 114). This association of the portion of textual content with thedigital scene may take any suitable form. For instance, the associationmay be contained in metadata associated with either or both of theportion of textual content or the digital scene; the association may bemade via a relational database that relates the portion of textualcontent to the digital scene; the association may be made by packagingthe digital scene and the portion of textual content into a single file;or any other suitable manner of association. In embodiments where theportion of textual content is associated with the digital scene by beingpackaged into a single file, the single file may contain additionalportions of textual content along with additional digital scenes,respectively associated with the additional portions of textual content.For example, if the textual content is a digital book, then the portionsof textual content may correspond with chapters, pages, or passages ofthe digital book and each of the chapters, pages, or passages may beindividually associated with respective digital scenes which may all becontained within a single file. The digital scene may include staticimages and/or animated images to augment the portion of textual content.

Augmentation module 108 may be coupled with digital content module 106as well as camera 104. In embodiments, augmentation module 108 may beconfigured to dynamically adapt the digital scene, or any portionthereof, associated with the portion of textual content based on thereal-time video feed captured by camera 104. In some embodiments, todynamically adapt the digital scene, augmentation module 108 mayincorporate the digital scene, or any portion thereof, with thereal-time video feed captured by camera 104 to produce augmentationvideo feed 114 to augment textual content 112. For instance, as depictedin FIG. 1, augmentation module 108 may receive real-time video feed ofphysical scene 116 and may overlay, or superimpose, the digital scene onthe real-time video feed of physical scene 116 to produce augmentationvideo feed 114. For example, as depicted, textual content 112 may be apage of an electronic book that a user of computing device 102 isreading. The digital scene associated with textual content 112 mayinclude a depiction of what is described in textual content 112. Asdiscussed above, augmentation module 108 may generate augmentation videofeed 114 to include the digital scene overlayed, or superimposed, on areal-time video feed of physical scene 118. This overlaying, orsuperimposition, may make it appear to the reader as if textual content112 is coming to life in front of the user's very eyes. In embodimentswhere only a portion of the digital scene is dynamically adapted basedon the real-time video feed, augmentation module 108 may be configuredto select the portion of the digital scene based on an orientation ofcamera 104. Such embodiments are discussed further in reference to FIG.3 below.

In some embodiments, content augmentation environment 122 may alsoinclude a plane calculation module 110 coupled with augmentation module108. Plane calculation module 110 may be configured to calculate one ormore planes (e.g., planes 118 and 120) contained within frames of thereal-time video feed. The one or more planes may be utilized byaugmentation module 108 to dynamically adapt the digital scene toconform to the one or more planes prior to incorporation of the digitalscene into the real-time video feed to produce the augmentation videofeed, to be described more fully below with reference to FIG. 2.

As depicted, in some embodiments, textual content 112 may be rendered ona first portion of the display device while augmentation video feed 114may be rendered on another portion of the display device. In otherembodiments, where computing device 102 may include more than onedisplay device, textual content 112 may be rendered on one of thedisplays while augmentation video feed 114 may be rendered on anotherdisplay device. In still other embodiments, augmentation module 108and/or digital content module 106 may be configured to accept input froma user of computing device to toggle between textual content 112 andaugmentation video feed 114.

While computing device 102 is depicted herein as a tablet, it will beappreciated that this is merely for illustrative purposes. Computingdevice 102 may take the form of any type of portable or stationarycomputing device, such as, but not limited to, a smart phone, tablet,laptop, desktop, kiosk, or wearable computing devices such as, forexample, Google Glass. Any computing device capable of carrying out theprocesses described herein is contemplated by this disclosure.

FIG. 2 is an illustrative depiction of an example content augmentationenvironment 122 generating an augmentation video feed 210. As discussedabove content augmentation environment 122 may include digital contentmodule 106, augmentation module 108 and plane calculation module 110. Asdepicted by the broken border, digital content module 106 and planecalculation module 110 may be present in some embodiments describedbelow and omitted in other embodiments. In embodiments, contentaugmentation environment 122 may be configured to take in real-timevideo feed 202 and digital scene 204 and output augmentation video feed210 for rendering on a display device of a computing device.

In some embodiments, augmentation module 108 may be configured toreceive digital scene 204 directly. In such embodiments, augmentationmodule may passively receive digital scene 204 or may actively retrievedigital scene 204 from a storage location. In other embodiments,augmentation module 108 may be configured to receive digital scene 204from digital content module 106.

In some embodiments, augmentation module 108 may be configured toreceive real-time video feed 202 directly for use in adapting digitalscene 204 based on the real-time video feed. In such embodiments,augmentation module 210 may incorporate digital scene 204 with real-timevideo feed 202 to create augmentation video feed 210. In otherembodiments, plane calculation module 110 may be configured to receivereal-time video feed 202 for processing and may in turn be configured toprovide real-time video feed 202 and the results of any processingperformed on real-time video feed 202 to augmentation module 108. Insuch embodiments, augmentation module 210 may be configured to utilizethe results of the processing, in addition to real-time video feed 202,in adapting digital scene 204.

In some embodiments, plane calculation module 110 may receive real-timevideo feed 202 and may calculate one or more planes contained withinreal-time video feed 202 (e.g., the plane created by table 206). Thismay be accomplished through any conventional process, for example, byutilizing depth and color information contained within real-time videofeed and captured by a camera (e.g., camera 104 of FIG. 1). From thisdepth and color information, plane calculation module 110 may calculatea three dimensional (3-D) point cloud. This 3-D point cloud may beutilized by plane calculation module 110 to create a 3-D mesh, such as apolygon mesh, triangle mesh, or any other such 3-D surface depiction.Plane calculation module 110, may then utilize the 3-D surface depictionto calculate the one or more 3-D planes of the physical scene, e.g.,table top, floor and wall(s), etc. In some embodiments, the one or more3D planes may be calculated by plane calculation module 110 based oneither marker based (e.g., Simultaneous Location and Mapping (SLAM)) ormarker-less detection. Alternatively, both techniques may be utilized bythe plane calculation module to calculate the one or more 3-D planes.The one or more planes and real-time video feed may then be passed toaugmentation module 108 which may be configured to conform digital scene204 to the one or more planes. Augmentation module 210 may be configuredto then incorporate the conformed digital scene with the real-time videofeed 202 to produce augmentation video feed 210. Through thisincorporation, augmentation video feed 210 may make it appear as if thedigital scene is resting on a surface, such as the surface of table 206,right in front of a user of content augmentation environment 122

FIG. 3 is an illustrative depiction of various camera orientations andthe effect of the various orientations on the portion of the digitalscene rendered on computing device 302, in accordance with variousembodiments of the present disclosure. As mentioned above, in someembodiments, an augmentation module (e.g., augmentation module 108 ofFIGS. 1 and 2) may be configured to select a portion of a digital scenebased on an orientation of a camera capturing a real-time video feed(e.g. camera 104 of FIG. 1). In such embodiments, as the orientation ofthe camera changes, the portion of the digital scene may change as well.In an arrangement where the camera is integrated into the computingdevice, movement of the computing device may correspond with movement ofthe camera. As a result, movement of the computing device discussedbelow will be understood to include a corresponding movement of theintegrated camera.

FIG. 3 depicts computing device 302 in three different orientations, A,B, and C, and the impact these orientations have on the digital sceneand an augmentation video feed. Computing device 302 may be configuredto carry out this process through the integration of a contentaugmentation environment (e.g., content augmentation environment 122 ofFIGS. 1 and 2). The content augmentation environment may be configuredto cause a portion of textual content 304 to be rendered on one portionof the display device and augmentation video feed 308 306 having aportion of a digital scene, associated with the portion of textualcontent 304, to be rendered on another portion of the display device.

At orientation A, computing device 302 may be positioned in an upwardsorientation. As depicted, augmentation video feed 308 306 at orientationA may be composed of a portion of a digital scene selected by thecontent augmentation environment, or a module thereof. This portion ofthe digital scene may include clouds 310 and a top portion of a boat 312incorporated with a real-time video feed. The real-time video feed,captured by the integrated camera, may include ceiling fan 308. As aresult, augmentation video feed 308 306 at orientation A reflects thatcomputing device 302 is positioned in an upwards orientation through theselection of a portion of the digital scene corresponding with such anorientation.

As computing device 302 is moved downwards to orientation B, theselected portion of the digital scene may change in a mannercorresponding with such movement. As depicted, augmentation video feed308 306 at orientation B may be composed of a different portion of thedigital scene. The different portion of the digital scene may beselected by the content augmentation environment, or a module thereof,based on the downward movement. This different portion of the digitalscene may still include clouds 310; however, the position of clouds 310on the display device may move vertically on the display device ascomputing device 302 is moved down. Furthermore, while only a top ofboat 312 was displayed at orientation A, almost the entirety of boat 312is displayed at orientation B. In addition to the changes to the portionof the digital scene, the physical scene with which the portion of thedigital scene is incorporated also changes based on the physical scenecaptured by the integrated camera at orientation B. As depicted, thephysical scene still includes a portion of ceiling fan 308; however,ceiling fan 308 in the physical scene has moved in a similar manner toclouds 310. In addition, the physical scene now includes a top of atable 314. As discussed above, the content augmentation environment maybe configured to calculate one or more planes created by table 314 andmay adapt the portion of the digital scene to conform to the one or moreplanes. As depicted, boat 312 of the digital scene has been adapted inthis manner to conform to table 314.

As computing device 302 is moved further downwards to orientation C, theselected portion of the digital scene continues to change in a mannercorresponding with such movement. As depicted, augmentation video feed308 306 at orientation C may be composed of a third portion of thedigital scene. The third portion of the digital scene may also beselected by the content augmentation environment, or a module thereof,based on the downward movement. As can be seen, clouds 310 depicted inorientations A and B have moved out of frame in orientation C along withceiling fan 308 of the physical scene. Boat 312 has moved furthervertically as computing device 302 moved further downwards and a largerportion of table 314 is now captured in the physical scene.

While only three orientations are described above, it will beappreciated that the transitions from one orientation to another may bedepicted by augmentation video feed in real-time as movement of thecomputing device is sensed. Such movement may be sensed in any mannerincluding, but not limited to, use of a gyroscope, accelerometer, and/ormarkers within frames of the real-time video feed. In addition, whilemovement of computing device 302 is discussed above in a single downwarddirection, the computing device may be moved in any direction includinglaterally.

FIG. 4 is an illustrative depiction of navigation from a first portionof textual content 304 to a second portion of textual content 402. FIG.4 continues from FIG. 3 and as a result some of the same referencenumbers are utilized therein. As depicted, computing device 302 maybegin with a rendering of a first portion of textual content 304 alongwith an augmentation video feed 306 depicting a digital scene,associated with the first portion of textual content 304, incorporatedwith a real-time video feed capture by the camera integrated withcomputing device 302.

In embodiments, content augmentation environment, or a module therein,may be configured to accept input from a user of computing device 302 tonavigate to a second portion of textual content 404. In suchembodiments, the user may navigate to the second portion of textualcontent 404 by, for example, interacting with a portion of the displaydevice of computing device 302, such as portion 402; through the use ofa table of contents, index, or the like where the user may select thesecond portion of textual content 404 from a list of various portions ofthe textual content; or in any other suitable manner.

Once content augmentation environment has received such input from theuser, the content augmentation environment may cause the second portionof textual content to be rendered on the display device of computingdevice 302 and may also cause a new digital scene associated with thesecond portion of textual content to be incorporated with the real-timevideo feed into a new augmentation video feed 406. As depicted, thereal-time video feed may not change unless there is a change to theorientation of the camera capturing the video feed. As such,augmentation video feed 406 includes table 314 from the real-time videofeed incorporated with the new digital scene, depicted here as dolphin408 jumping out of water 410.

FIG. 5 illustrates an example process flow 500 for dynamic adaptation ofa digital scene to augment textual content, in accordance with variousembodiments of the present disclosure. Process flow 500 may be carriedout by a content augmentation environment executing on a computingdevice, such as the content augmentation environment discussed elsewhereherein, or any modules or combination of modules of the contentaugmentation environment, hereinafter collectively referred to ascontent augmentation environment for simplicity.

The process may begin at block 502 where a portion of textual contentmay be received by the content augmentation environment for rendering ona display device coupled with the content augmentation environment. Inaddition, a digital scene associated with the textual content may alsobe received by content augmentation environment. In some embodiments,content augmentation environment may receive the portion of textualcontent and the digital scene from another component of computingdevice. In other embodiments, content augmentation environment mayretrieve the portion of textual content and the associated digitalscene, for example, in response to selection of the portion of textualcontent by a user. In such embodiments, content augmentation environmentmay retrieve the portion of textual content and the associated digitalscene from a local storage location or a remote storage location. Insome embodiments, the portion of textual content and the associateddigital scene may be provided by a remote service, such as a serviceproviding digital books, magazines, etc.

Once the portion of textual content and the associated digital scenehave been received by the content augmentation environment, the processmay proceed to block 504 where content augmentation environment mayreceive a real-time video feed captured by a camera coupled with thecontent augmentation environment. At block 506 content augmentationenvironment may dynamically adapt, as discussed elsewhere herein, aportion of the digital scene based on the real-time video feed forrendering on a display device coupled with the content augmentationenvironment.

FIG. 6 illustrates an example process flow 600 for selecting a portionof a digital scene based on camera orientation, in accordance withvarious embodiments of the present disclosure. Process flow 600 may becarried out by a content augmentation environment executing on acomputing device, such as the content augmentation environment discussedelsewhere herein, or any modules or combination of modules of thecontent augmentation environment, hereinafter collectively referred toas content augmentation environment for simplicity.

The process may begin at block 602 where movement of the camera to adifferent orientation may be detected by content augmentationenvironment. Such movement may be sensed in any manner including, butnot limited to, use of a gyroscope, accelerometer, and/or markers withinframes of the real-time video feed. Once movement of the camera to adifferent orientation is detected, a portion of the digital scene basedon the different orientation may be selected by content augmentationenvironment at block 604. At block 606 content augmentation environmentmay dynamically adapt the selected portion of the digital scene based onthe real-time video feed for rendering on a display device to augment aportion of textual content.

FIG. 7 illustrates an example process flow 700 for navigation from oneportion of textual content to another portion of textual content, inaccordance with various embodiments of the present disclosure. Processflow 700 may be carried out by a content augmentation environmentexecuting on a computing device, such as the content augmentationenvironment discussed elsewhere herein, or any modules or combination ofmodules of the content augmentation environment, hereinaftercollectively referred to as content augmentation environment forsimplicity.

The process may begin at block 702 where content augmentationenvironment may receive input to navigate to another portion of textualcontent associated with another digital scene. In embodiments, the inputmay be received in response to a user of the computing deviceinteracting with navigational input portion of a display device, such as402 of FIG. 4. In other embodiments the input may be received inresponse to a user selecting another portion of textual content from alist of various portions of textual content such as a table of contents,index, etc.

Once the input to navigate to another portion of textual content hasbeen received by the content augmentation environment, the process mayproceed to block 704 where content augmentation environment may receivea real-time video feed captured by a camera coupled with the contentaugmentation environment. At block 706 content augmentation environmentmay dynamically adapt, as discussed elsewhere herein, a portion of theanother digital scene based on the real-time video feed for rendering ona display device coupled with the content augmentation environment.

Referring now to FIG. 8, wherein an example computing device suitable toimplement a content augmentation environment 122, in accordance withvarious embodiments, is illustrated. As shown, computing device 800 mayinclude one or more processors or processor cores 802, and system memory804. In embodiments, multiple processor cores 802 may be disposed on onedie. For the purpose of this application, including the claims, theterms “processor” and “processor cores” may be considered synonymous,unless the context clearly requires otherwise. Additionally, computingdevice 800 may include mass storage device(s) 806 (such as diskette,hard drive, compact disc read-only memory (CD-ROM), and so forth),input/output (I/O) device(s) 808 (such as camera, display device,keyboard, cursor control, gyroscope, accelerometer, and so forth), andcommunication interfaces 810 (such as network interface cards, modems,and so forth). In embodiments, a display device may be touch screensensitive and may include a display screen, one or more processors,storage medium, and communication elements. Further, it may be removablydocked or undocked from a base platform having the keyboard. Theelements may be coupled to each other via system bus 812, which mayrepresent one or more buses. In the case of multiple buses, they may bebridged by one or more bus bridges (not shown).

Each of these elements may perform its conventional functions known inthe art. In particular, system memory 804 and mass storage device(s) 806may be employed to store a working copy and a permanent copy ofprogramming instructions implementing the operations described earlier,e.g., but not limited to, operations associated with digital contentmodule 106, augmentation module 108, plane calculation module 110,and/or content augmentation environment 122, generally referred to ascomputational logic 822. The various operations may be implemented byassembler instructions supported by processor(s) 802 or high-levellanguages, such as, for example, C, that may be compiled into suchinstructions.

The permanent copy of the programming instructions may be placed intopermanent mass storage device(s) 806 in the factory, or in the field,through, for example, a distribution medium (not shown), such as acompact disc (CD), or through communication interface 810 (from adistribution server (not shown)). That is, one or more distributionmedia having an implementation of digital content module 106,augmentation module 108, plane calculation module 110, and/or contentaugmentation environment 122 may be employed to distribute thesecomponents to various computing devices.

The number, capability, and/or capacity of these elements 810-812 mayvary, depending on the intended use of example computing device 800,e.g., whether example computer 800 is a smartphone, tablet, ultrabook,laptop, or desktop. The constitutions of these elements 810-812 areotherwise known, and accordingly will not be further described.

FIG. 9 illustrates an example non-transitory computer-readable storagemedium having instructions configured to practice all or selected onesof the operations associated with the processes described above. Asillustrated, non-transitory computer-readable storage medium 902 mayinclude a number of programming instructions 904. Programminginstructions 904 may be configured to enable a device, e.g., computingdevice 800, in response to execution of the programming instructions, toperform one or more operations of the processes described in referenceto FIGS. 1-7. In alternate embodiments, programming instructions 904 maybe disposed on multiple non-transitory computer-readable storage media902 instead. In still other embodiments, programming instructions 904may be encoded in transitory computer-readable signals.

Referring back to FIG. 8, for one embodiment, at least one of processors802 may be packaged together with computational logic 822 (in lieu ofstoring in memory 804 and/or mass storage 806) configured to perform oneor more operations of the processes described with reference to FIGS.1-7. For one embodiment, at least one of processors 802 may be packagedtogether with computational logic 822 configured to practice aspects ofthe methods described in reference to FIGS. 1-7 to form a System inPackage (SiP). For one embodiment, at least one of processors 802 may beintegrated on the same die with computational logic 822 configured toperform one or more operations of the processes described in referenceto FIGS. 1-7. For one embodiment, at least one of processors 802 may bepackaged together with computational logic 822 configured to perform oneor more operations of the process described in reference to FIGS. 1-7 toform a System on Chip (SoC). Such an SoC may be utilized in any suitablecomputing device.

Although certain embodiments have been illustrated and described hereinfor purposes of description, a wide variety of alternate and/orequivalent embodiments or implementations calculated to achieve the samepurposes may be substituted for the embodiments shown and describedwithout departing from the scope of the present disclosure. Thisapplication is intended to cover any adaptations or variations of theembodiments discussed herein. Therefore, it is manifestly intended thatembodiments described herein be limited only by the claims.

Where the disclosure recites “a” or “a first” element or the equivalentthereof, such disclosure includes one or more such elements, neitherrequiring nor excluding two or more such elements. Further, ordinalindicators (e.g., first, second, or third) for identified elements areused to distinguish between the elements, and do not indicate or imply arequired or limited number of such elements, nor do they indicate aparticular position or order of such elements unless otherwisespecifically stated.

Embodiments of the disclosure can take the form of an entirely hardwareembodiment, an entirely software embodiment or an embodiment containingboth hardware and software elements. In various embodiments, software,may include, but is not limited to, firmware, resident software,microcode, and the like. Furthermore, the disclosure can take the formof a computer program product accessible from a computer-usable orcomputer-readable medium providing program code for use by or inconnection with a computer or any instruction execution system. As usedherein, module may refer to a software module, a hardware module, or anynumber or combination thereof.

As used herein, the term module includes logic that may be implementedin a hardware component or device, software or firmware that may be runor running on a processor, or a combination of processors. The modulesmay be distinct and independent components integrated by sharing orpassing data, or the modules may be subcomponents of a single module, orbe split among several modules. The components may be processes runningon, or implemented on, a single compute node or distributed among aplurality of compute nodes running in parallel, concurrently,sequentially or a combination, as described more fully in conjunctionwith the flow diagrams in the figures.

For the purposes of this description, a computer-usable orcomputer-readable medium can be any apparatus that can contain, store,communicate, propagate, or transport the program for use by or inconnection with the instruction execution system, apparatus, or device.The medium can be an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system (or apparatus or device) or apropagation medium. Examples of a computer-readable medium include asemiconductor or solid state memory, magnetic tape, a removable computerdiskette, a random access memory (RAM), a read-only memory (ROM), arigid magnetic disk and an optical disk. Current examples of opticaldisks include compact disk-read only memory (CD-ROM), compactdisk-read/write (CD-R/W) and DVD.

EXAMPLES

Some non-limiting examples are:

Example 1 is a computing device comprising one or more display devices;a digital content module coupled with the one or more display devices,the digital content module to cause a portion of textual content to berendered on the one or more display devices, wherein the textual contentis associated with a digital scene to be utilized in augmenting thetextual content; and an augmentation module coupled with the digitalcontent module and the one or more display devices to dynamically adaptthe digital scene, based at least in part on a real-time video feedcaptured by a camera communicatively coupled with the computing device,to be rendered on the one or more display devices to augment the textualcontent.

Example 2 may include the subject matter of Example 1, wherein todynamically adapt the digital scene is to incorporate at least a portionof the digital scene with the real time video feed to produce anaugmentation video feed to augment the textual content.

Example 3 may include the subject matter of Example 2, wherein thedigital content module is to cause the textual content to be rendered ona first portion of the one or more display devices, and the augmentationmodule is to cause the augmentation video feed to be rendered on asecond portion of the one or more display devices.

Example 4 may include the subject matter of either of Examples 2 or 3,further comprising a plane calculation module coupled with theaugmentation module to calculate one or more planes contained withinframes of the real-time video feed, and wherein to dynamically adapt theportion of the digital scene is further to adapt the portion of thedigital scene to conform to the one or more planes prior toincorporation into the real-time video feed to produce the augmentationvideo feed.

Example 5 may include the subject matter of any one of Examples 2-4,wherein the augmentation module is to select the portion of the digitalscene based on an orientation of the camera.

Example 6 may include the subject matter of Example 5, furthercomprising the camera, wherein a change in an orientation of thecomputing device causes a corresponding change to the orientation of thecamera.

Example 7 may include the subject matter of Example 5, wherein theaugmentation module is further to: detect movement of the camera to anew orientation; select another portion of the digital scene thatcorresponds with the new orientation; and dynamically adapt the anotherportion of the digital scene based at least in part on the real-timevideo feed captured by the camera at the new orientation; whereindynamically adapt includes incorporation of the another portion of thedigital scene with the real-time video feed to modify the augmentationvideo feed to reflect the new orientation.

Example 8 may include the subject matter of Example 7, furthercomprising a gyroscope or an accelerometer, wherein the augmentationmodule is to detect a change in orientation of the camera through eitheror both of the gyroscope or accelerometer.

Example 9 may include the subject matter of Example 7, wherein the videofeed comprises a marker, and the augmentation module is to detect achange in orientation of the camera through detection of movement of themarker within the video feed.

Example 10 may include the subject matter of any one of Examples 1-9,wherein the digital content module is further to render a second portionof the textual content in response to input to navigate to the secondportion of the textual content, wherein the second portion of thetextual content is associated with another digital scene to be renderedto augment the second portion of the textual content, and wherein theaugmentation module is to dynamically adapt the another digital scene inview of the real-time video feed to augment the second portion of thetextual content.

Example 11 may include the subject matter of any one of Examples 1-10,wherein the first portion of the one or more display devices is a firstdisplay device of the one or more display devices and the second portionof the one or more display devices is a second display device of the oneor more display devices.

Example 12 may include the subject matter of any one of Examples 1-11,wherein the computing device is a tablet, e-reader, smartphone, laptop,or wearable computing device.

Example 13 is a computer implemented method comprising receiving, by acontent augmentation environment of a computing device, a portion oftextual content for rendering on one or more display devices of thecomputing device, wherein the textual content is associated with adigital scene to be utilized in augmenting the textual content; anddynamically adapting, by the content augmentation environment, thedigital scene, based at least in part on a real-time video feed capturedby a camera of the computing device, for rendering on the one or moredisplay devices to augment the textual content.

Example 14 may include the subject matter of Example 13, whereindynamically adapting the digital scene further comprises incorporatingat least a portion of the digital scene with the real time video feed toproduce an augmentation video feed to augment the textual content.

Example 15 may include the subject matter of Example 14, furthercomprising causing, by the content augmentation environment, the textualcontent to be rendered on a first portion of the one or more displaydevices, and the augmentation video feed to be rendered on a secondportion of the one or more display devices.

Example 16 may include the subject matter of either of Examples 14 or15, wherein dynamically adapting the digital scene further comprises:calculating one or more planes contained within frames of the real-timevideo feed; and adapting the portion of the digital scene to conform tothe one or more planes prior to incorporating the portion of the digitalscene into the real-time video feed to produce the augmentation videofeed.

Example 17 may include the subject matter of any one of Examples 14-16,further comprising selecting, by the content augmentation environment,the portion of the digital scene based on an orientation of the camera.

Example 18 may include the subject matter of Example 17, whereinchanging an orientation of the computing device causes a correspondingchange to the orientation of the camera.

Example 19 may include the subject matter of Example 17, furthercomprising: detecting, by the content augmentation environment, movementof the camera to a new orientation; selecting, by the contentaugmentation environment, another portion of the digital scene thatcorresponds with the new orientation; and dynamically adapting, by thecontent augmentation environment, the another portion of the digitalscene based at least in part on the real-time video feed captured by thecamera at the new orientation; wherein dynamically adapting includesmodifying the augmentation video feed to reflect the new orientation byincorporating the another portion of the digital scene with thereal-time video feed.

Example 20 may include the subject matter of Example 19, whereindetecting movement of the camera to the new orientation furthercomprises detecting the movement of the camera via either or both of agyroscope or accelerometer.

Example 21 may include the subject matter of Example 19, whereindetecting movement of the camera to the new orientation furthercomprises detecting movement of a marker within the video feed.

Example 22 may include the subject matter of any one of Examples 13-21,further comprising: receiving, by the content augmentation environment,input to navigate to a second portion of the textual content, whereinthe second portion of the textual content is associated with anotherdigital scene for rendering to augment the second portion of the textualcontent, and wherein the content augmentation environment is todynamically adapt the another digital scene in view of the real-timevideo feed to augment the second portion of the textual content.

Example 23 may include the subject matter of any one of Examples 13-22,wherein the first portion of the one or more display devices is a firstdisplay device of the one or more display devices and the second portionof the one or more display devices is a second display device of the oneor more display devices.

Example 24 is one or more computer-readable storage media havinginstructions stored thereon which, when executed by a computing device,provide the computing device with a content augmentation environment to:select a portion of textual content to be rendered on one or moredisplay devices of the computing device, wherein the textual content isassociated with a digital scene to be utilized in augmentation of thetextual content; and dynamically adapt the digital scene, based at leastin part on a real-time video feed captured by a camera of the computingdevice, to be rendered on the one or more display devices to augment thetextual content.

Example 25 may include the subject matter of Example 24, wherein todynamically adapt the digital scene further comprises incorporation ofat least a portion of the digital scene with the real time video feed toproduce an augmentation video feed to augment the textual content.

Example 26 may include the subject matter of Example 25, wherein thecontent augmentation environment is further to cause the textual contentto be rendered on a first portion of the one or more display devices,and the augmentation video feed to be rendered on a second portion ofthe one or more display devices.

Example 27 may include the subject matter of either of Examples 25 or26, wherein the content augmentation environment is further to calculateone or more planes contained within frames of the real-time video feed,and wherein to dynamically adapt the digital scene further comprisesadaptation of the portion of the digital scene to conform to the one ormore planes prior to incorporation of the portion of the digital sceneinto the real-time video feed to produce the augmentation video feed.

Example 28 may include the subject matter of any one of Examples 25-27,wherein the content augmentation environment is further to select theportion of the digital scene based on an orientation of the camera.

Example 29 may include the subject matter of Example 28, wherein achanging in orientation of the computing device causes a correspondingchange to the orientation of the camera.

Example 30 may include the subject matter of Example 28, wherein thecontent augmentation environment is further to: detect movement of thecamera to a new orientation; select another portion of the digital scenethat corresponds with the new orientation; and dynamically adapt theanother portion of the digital scene based at least in part on thereal-time video feed captured by the camera at the new orientation;wherein to dynamically adapt includes modification of the augmentationvideo feed to reflect the new orientation through incorporation of theanother portion of the digital scene with the real-time video feed.

Example 31 may include the subject matter of Example 30, wherein todetect movement of the camera to the new orientation further comprisesdetect the movement of the camera via either or both of a gyroscope oraccelerometer.

Example 32 may include the subject matter of Example 30, wherein todetect movement of the camera to the new orientation further comprisesdetect movement of a marker within the video feed.

Example 33 may include the subject matter of any one of Examples 24-32,wherein the content augmentation environment is further to: receiveinput to navigate to a second portion of the textual content, whereinthe second portion of the textual content is associated with anotherdigital scene to be rendered to augment the second portion of thetextual content; and dynamically adapt the another digital scene in viewof the real-time video feed to augment the second portion of the textualcontent.

Example 34 may include the subject matter of any one of Examples 24-33,wherein the first portion of the one or more display devices is a firstdisplay device of the one or more display devices and the second portionof the one or more display devices is a second display device of the oneor more display devices.

Example 35 is a computing device comprising: means for selecting aportion of textual content for rendering on one or more display devicesof the computing device, wherein the textual content is associated witha digital scene to be utilized in augmenting the textual content; andmeans for dynamically adapting the digital scene, based at least in parton a real-time video feed captured by a camera of the computing device,for rendering on the one or more display devices to augment the textualcontent.

Example 36 may include the subject matter of Example 35, wherein themeans for dynamically adapting the digital scene further comprises meansfor incorporating at least a portion of the digital scene with the realtime video feed to produce an augmentation video feed to augment thetextual content.

Example 37 may include the subject matter of Example 36, furthercomprising means for causing the textual content to be rendered on afirst portion of the one or more display devices, and the augmentationvideo feed to be rendered on a second portion of the one or more displaydevices.

Example 38 may include the subject matter of either of Examples 36 or37, further comprising means for calculating one or more planescontained within frames of the real-time video feed, wherein dynamicallyadapting the digital scene further comprises adapting the portion of thedigital scene to conform to the one or more planes prior toincorporating the portion of the digital scene into the real-time videofeed to produce the augmentation video feed.

Example 39 may include the subject matter of any one of Examples 36-38,further comprising means for selecting the portion of the digital scenebased on an orientation of the camera.

Example 40 may include the subject matter of Example 39, whereinchanging an orientation of the computing device causes a correspondingchange to the orientation of the camera.

Example 41 may include the subject matter of Example 39, furthercomprising: means for detecting movement of the camera to a neworientation; means for selecting another portion of the digital scenethat corresponds with the new orientation; and means for dynamicallyadapting the another portion of the digital scene based at least in parton the real-time video feed captured by the camera at the neworientation; wherein dynamically adapting includes modifying theaugmentation video feed to reflect the new orientation by incorporatingthe another portion of the digital scene with the real-time video feed.

Example 42 may include the subject matter of Example 41, whereindetecting movement of the camera to the new orientation furthercomprises detecting the movement of the camera via either or both of agyroscope or accelerometer.

Example 43 may include the subject matter of Example 41, whereindetecting movement of the camera to the new orientation furthercomprises detecting movement of a marker within the video feed.

Example 44 may include the subject matter of any one of Examples 35-43,further comprising: means for receiving input to navigate to a secondportion of the textual content, wherein the second portion of thetextual content is associated with another digital scene for renderingto augment the second portion of the textual content; and means fordynamically adapting the another digital scene in view of the real-timevideo feed to augment the second portion of the textual content.

Example 45 may include the subject matter of any one of Examples 35-44,wherein the first portion of the one or more display devices is a firstdisplay device of the one or more display devices and the second portionof the one or more display devices is a second display device of the oneor more display devices.

Although specific embodiments have been illustrated and describedherein, it will be appreciated by those of ordinary skill in the artthat a wide variety of alternate and/or equivalent implementations maybe substituted for the specific embodiments shown and described, withoutdeparting from the scope of the embodiments of the disclosure. Thisapplication is intended to cover any adaptations or variations of theembodiments discussed herein. Therefore, it is manifestly intended thatthe embodiments of the disclosure be limited only by the claims and theequivalents thereof.

What is claimed is:
 1. A computing device comprising: one or moredisplay devices; a digital content module coupled with the one or moredisplay devices, the digital content module to cause a portion oftextual content to be rendered on the one or more display devices,wherein the portion of textual content is associated with a digitalscene to be utilized in augmenting the textual content, wherein theportion of textual context is associated with content of a digitalmagazine and information associating the portion of textual context withthe digital scene is included in metadata of the portion of textualcontent; and an augmentation module coupled with the digital contentmodule and the one or more display devices to dynamically adapt thedigital scene, based at least in part on a real-time video feed capturedby a camera communicatively coupled with the computing device, to berendered on the one or more display devices to augment the textualcontent, wherein the adapted digital scene is rendered via anaugmentation video feed displayed according to a panning of the adapteddigital scene in response to an upwards, downwards, or lateralorientation of the camera and including digital elements of the adapteddigital scene mapped to corresponding locations of physical elements inthe real-time video feed, wherein the digital content module is toaccess a database that relates the portion of textual content to thedigital scene and the access is provided via the metadata of the portionof textual content.
 2. The computing device of claim 1, wherein todynamically adapt the digital scene is to incorporate at least a portionof the digital scene with the real-time video feed to produce theaugmentation video feed to augment the textual content.
 3. The computingdevice of claim 2, wherein the digital content module is to cause thetextual content to be rendered on a first portion of the one or moredisplay devices, and the augmentation video feed to be rendered on asecond portion of the one or more display devices.
 4. The computingdevice of claim 2, further comprising a plane calculation module coupledwith the augmentation module to calculate one or more planes containedwithin frames of the real-time video feed, and wherein to dynamicallyadapt the portion of the digital scene is further to adapt the portionof the digital scene to conform to the one or more planes prior toincorporation into the real-time video feed to produce the augmentationvideo feed.
 5. The computing device of claim 1, further comprising thecamera, wherein a change in an orientation of the computing devicecauses a corresponding change to the orientation of the camera.
 6. Thecomputing device of claim 1, wherein the augmentation module is furtherto: detect movement of the camera to a new location; select anotherportion of the digital scene that corresponds with the new location; anddynamically adapt the another portion of the digital scene based atleast in part on the real-time video feed captured by the camera at thenew location; wherein dynamically adapt includes incorporation of theanother portion of the digital scene with the real-time video feed tomodify an augmentation video feed to reflect the new location.
 7. Thecomputing device of claim 6, further comprising a gyroscope or anaccelerometer, wherein the augmentation module is to detect a change inorientation of the camera through either or both of the gyroscope oraccelerometer.
 8. The computing device of claim 1, wherein the computingdevice is a tablet, e-reader, smartphone, laptop, or wearable computingdevice.
 9. The computing device of claim 1, wherein the informationincluded in the metadata of the portion of textual content includesinformation associating the portion of textual context with a digitalscene including animated or static images to be displayed according tothe panning of the adapted digital scene.
 10. A computer implementedmethod comprising: receiving, by a content augmentation environment of acomputing device, a portion of textual content for rendering on one ormore display devices of the computing device, wherein the textualcontent is associated with a digital scene to be utilized in augmentingthe textual content, wherein the textual context is associated withcontent of a digital magazine and information associating the textualcontext with the digital scene is included in metadata of the textualcontent accessed by the content augmentation environment; dynamicallyadapting, by the content augmentation environment, a portion of thedigital scene, based at least in part on a real-time video feed capturedby a camera of the computing device, for rendering on the one or moredisplay devices to augment the portion of textual content, wherein theportion of the digital scene that is adapted is rendered via anaugmentation video feed displayed according to a panning of the digitalscene in response to an upwards, downwards, or lateral orientation ofthe camera and includes the portion of the digital scene includingdigital elements mapped to corresponding locations of physical elementsin the real-time video feed, and wherein the content augmentationenvironment is to access a database that relates the portion of textualcontent to the digital scene and the access is provided via the metadataof the portion of textual content.
 11. The method of claim 10, furthercomprising causing, by the content augmentation environment, the textualcontent to be rendered on a first portion of the one or more displaydevices, and the augmentation video feed to be rendered on a secondportion of the one or more display devices.
 12. The method of claim 10,wherein dynamically adapting the portion of the digital scene furthercomprises calculating one or more planes contained within frames of thereal-time video feed; and adapting the portion of the digital scene toconform to the one or more planes prior to incorporating the portion ofthe digital scene into the real-time video feed to produce theaugmentation video feed.
 13. The method of claim 10, further comprising:detecting, by the content augmentation environment, movement of thecamera to a new location; selecting, by the content augmentationenvironment, another portion of the digital scene that corresponds withthe new location; and dynamically adapting, by the content augmentationenvironment, the another portion of the digital scene based at least inpart on the real-time video feed captured by the camera at the newlocation; wherein dynamically adapting includes modifying anaugmentation video feed to reflect the new location by incorporating theanother portion of the digital scene with the real-time video feed. 14.The method of claim 10, further comprising: receiving, by the contentaugmentation environment, input to navigate to a second portion of thetextual content, wherein the second portion of the textual content isassociated with another digital scene for rendering to augment thesecond portion of the textual content, and wherein the contentaugmentation environment is to dynamically adapt the another digitalscene in view of the real-time video feed to augment the second portionof the textual content.
 15. One or more non-transitory computer-readablestorage media having instructions stored thereon which, when executed bya computing device, provide the computing device with a contentaugmentation environment to: select a portion of textual content to berendered on one or more display devices of the computing device, whereinthe textual content is associated with a digital scene to be utilized inaugmentation of the textual content and wherein the textual context isassociated with content of a digital magazine and informationassociating the portion of textual context with the digital scene isincluded in metadata of the textual content; dynamically adapt thedigital scene, based at least in part on a real-time video feed capturedby a camera of the computing device, to be rendered on the one or moredisplay devices to augment the textual content; wherein the digitalscene that is adapted is to be rendered via an augmentation video feeddisplayed according to a panning of the digital scene in response to anupwards, downwards, or lateral orientation of the camera and includes aselected portion of the digital scene including digital elements mappedto corresponding locations of physical elements captured in thereal-time video feed; and access a database that relates the portion oftextual content to the digital scene, wherein the access is provided viathe metadata of the portion of textual content.
 16. The non-transitorycomputer-readable storage media of claim 15, wherein the contentaugmentation environment is further to cause the textual content to berendered on a first portion of the one or more display devices, and theaugmentation video feed to be rendered on a second portion of the one ormore display devices.
 17. The non-transitory computer-readable storagemedia of claim 15, wherein the content augmentation environment isfurther to calculate one or more planes contained within frames of thereal-time video feed, and wherein to dynamically adapt the digital scenefurther comprises adaptation of the portion of the digital scene toconform to the one or more planes prior to an incorporation of theportion of the digital scene into the real-time video feed to producethe augmentation video feed.
 18. The non-transitory computer-readablestorage media of claim 15, wherein the content augmentation environmentis further to: detect movement of the camera to a new location; selectanother portion of the digital scene that corresponds with the newlocation; and dynamically adapt the another portion of the digital scenebased at least in part on the real-time video feed captured by thecamera at the new location; wherein to dynamically adapt includesmodification of an augmentation video feed to reflect the new locationthrough incorporation of the another portion of the digital scene withthe real-time video feed.
 19. The non-transitory computer-readablestorage media of claim 15, wherein to detect movement of the camera tothe upwards, downwards, or lateral orientation further comprises todetect movement of a marker within the real time video feed.
 20. Thenon-transitory computer-readable storage media of claim 15, wherein thecontent augmentation environment is further to: receive input tonavigate to a second portion of the textual content, wherein the secondportion of the textual content is associated with another digital sceneto be rendered to augment the second portion of the textual content; anddynamically adapt the another digital scene in view of the real-timevideo feed to augment the second portion of the textual content.
 21. Thenon-transitory computer-readable storage media of claim 20, wherein afirst portion of the one or more display devices is a first displaydevice of the one or more display devices and the second portion of theone or more display devices is a second display device of the one ormore display devices.